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An in-between “implicit” and “explicit” complexity: Automata 


CLEMENT AUBERT 


Abstract. Implicit Computational Complexity (ICC) makes two aspects 
implicit, by manipulating programming languages rather than models of com¬ 
putation, and by internalizing the bounds rather than using external measure. 
We survey how automata theory contributed to complexity with a machine- 
dependant with implicit bounds model. 


Introduction 

This survey justifies a fine-grained view on the definition of what Implicit Com¬ 
putational Complexity (ICC) wants to keep implicit: 



Machine-dependant 

Machine-independant 


Turing machine, 

Bounded recursion on notation [9], 

Explicit bounds 

Random access machine, 

Bounded arithmetic [6], 

Counter machine, ... 

Bounded linear logic [13], ... 


Automaton, 

Descriptive complexity [11], 

Implicit bounds 

Auxiliary pushdown machine [10], 

Recursion on notation [5], 


Boolean circuit, ... 

Tiered recurrence [19], ... 


It is common to refer to the top-left as the classical, or explicit , approach to 
complexity. The three others techniques keep something implicit. The bottom-right 
way is considered as the true implicit complexity, the one that produces all the 
motivating perspectives: quasi-interpretations, non-size-increasing computation, soft 
lambda-calculus and linear logics, to name a few. But there might be hesitations 
when defining ICC, for neither the “machine-independent” neither the “without 
explicit bounds” slogans are precise enough. 

The machine-dependant with implicit bounds variant will be our subject. It 
characterizes complexity classes by bounding the quality of the resources of a machine 
rather than its quantity. To our knowledge, automata are the most canonical model 
of this enterprise, which dates back to the 70’s: “we have attempted to characterize 
several tape and time complexity classes of Turing machines in terms of devices whose 
definitions involve only ways in which their infinite memory may be manipulated 
and no restrictions are imposed on the amount of memory that they use.” ([16, 

p. 88]) 
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Automata, characterizations and separation results 


Definition 1. For k ^ 1, 1^0, a 2-way non-deterministicfinite automaton with 
fc-heads and l pushdown stacks (2NFA(k,l)) is a tuple M = {S,i,F, A, B, >,<,□, a} 
where: 

• S is the finite set of states, with i£ S the initial state and FC S the set of 
accepting states; 

• A is the input alphabet, B is the stack alphabet; 

• > and <3 are the left and right endmarkers, >,<]^ A; 

• □ is the bottom symbol of the stack, □ ^ B; 

From now on, we let (resp. B^) be AU {>,<]} (resp. 5U{0}J. 

• cr C (5x (A M ) fe x (B[fi) 1 ) x (Sx {— l,0, + l} fe x {pop,peek,push(b)} 1 ) is the 
transition relation, where —1 means to move the head one cell to the left, 0 
means to keep the head on the current cell and +1 means to move it one 
cell to the right. Regarding the pushdown stacks, pop means “erase the top 
symbol”, peek “do nothing”, and, for all b £ B, push{b) is “write b on top 
of the stack”. 

Given an input n £ A*, the automata is initiated in state i, with \> n <\ written on 
its only tape, all its heads at D> and all its stacks containing □. It makes (non- 
deterministic) transitions according to a and halt accepting as soon as it reaches a 
state belonging to F. We impose that the heads cannot move beyond the endmarkers 
and that the bottom stack symbol □ cannot be erased (“popped”). 

Finally, we denote with 2NFA(k,l) the class of languages recognized by the 
2NFA(k,l) automaton. Moreover, we let 2NFA(*,1) = Ufc^i2NFA(k,l). 


Theorem 1. The following table gives the correspondence between automata and 
languages (or predicates): 

Automata Language 


a) 2NFA(1,2) 

b) 2NFA(*,1) 

c) 2NFA(*,0) 

d) 2NFA(1,1) 

e) 2NFA(1,0) 


Computable 
Polynomial time 
Logarithmic space 
Context-free 
Regular 


Proof. We just sketch them, and provide references for the most difficult one. We 
always suppose that n is the input and \n\ its size. 

a) C: Given a computable language, by the Church-Turing thesis, there exists 
a Turing machine T that decides it. Using some classical theorem, we can always 
assume that T has a single reading head and a single read-write tape. A 2NFA(1,2) 
can simulate T by simulating the movement of the read-only head with its head, 
and the content of the read-write tape with its two pushdown stacks. The first (resp. 
second) pushdown stack store the content on the left (resp. right) of the read-write 
head. 


a) D: As 2NFA(1,2) are restrictions of Turing Machines, their simulation is 
obvious. 


b) C: This part amounts to designing an equivalent Turing machine whose 
movements of heads follow a regular pattern. That permits to seamlessly simulate 
the content of the read-write tape with a pushdown stack. A complete proof [10, 
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pp. 9-11] as well as a precise algorithm [27, pp. 238-240] can be found in the 
literature. 

b) 7>: This way gave birth to memoization. In a nutshell, simulating a 2NFA(*,1) 
with a polynomial-time Turing machine cannot amount to simulate step-by-step the 
automaton. The reason is that for any automaton, one can design an automaton 
that recognizes the same language but runs exponentially slower [1, p. 197]. The 
technique invented by Alfred V. Aho et. al [1] and made popular by Stephen A. Cook 
consists in building a “memoization table” that allows the Turing machine to create 
shortcuts in the simulation of the automaton, decreasing drastically its computation 
time. It is a “ clever evaluation strategy , applicable whenever the results of certain 
computations are needed more than once” [2, p. 348]. A nice explanation in the case 
of single head automata is in a recent and short article by R. Gliick [14]. 

c) C: Let T be a Turing machine deciding the predicate with m x log(|n|) space. 
Remark that an integer represented by a binary string of length p is no greater than 
2 P , which takes 2 P bits in unary. Then, a binary string of length log(|n|) cannot be 
greater than |n|. So the content of the read-write tape and the position of its head 
is encoded as distances between [> and the read-only heads of the automata. That 
needs to compute simple operations (modulo, multiplication and remaining of a 
division) thanks to an extra head, but to+ 3 heads [25, pp. 191-192] are sufficient to 
perform this simulation. Simplest and the fastest simulations exists [27, pp. 223-225], 
but the overhead in terms of heads is more important. 

c) 3: The addresses of the heads on the input n takes log(|n|) to we written, 
hence a log-space Turing machine can easily simulate a 2NFA(*,0). 

d) and e): The proofs of those two fundamentals results are beyond the scope 
of this small survey. Their original proofs are respectively due to Chomsky [7, 
Theorem 1, p. 188] and Kleene [18, Theorem 6]. 

□ 

In the c) case, taking a deterministic automata 2DFA(*,0) yields a characteri¬ 
zation of deterministic log-space predicate L (whereas we characterized here the 
non-deterministic case NL). In the b) case, both deterministic and non-deterministic 
automata characterize deterministic polynomial time. 

Automata can also be restricted to be 1-way (simply remove the —1 instruction 
from the transition relation). In the e) case of regular language (which are equal to lin¬ 
ear space), we get in fact 1DFA(1,0) = 2DFA(1,0) = 1NFA(1,0) = 2DFA(1,0). 


Theorem 2 (Other results of interest). 

([24, p. 214]) 

([15, p. 95]) 

2NFA(k, 1) C 2DFA(4 x k, 1) 

lDFA(k,0) C 2DFA(k, 0) 

([25, p. 189]) 

([15, p. 95]) 

2NFA(k,0) C 2NFA(2 x k, 1) 

lNFA(k,0) C 2NFA(k, 0) 

([8]) lDFA(k, 1) C lNFA(k, 1) 

([28, p. 339]) 

([23, pp. 75-76]) 

lDFA(k.O) C 1NFA(2,0) 

NL = L 

([8]) lDFA(k, 1) C lNFA(k, 1) 

iff 

([25, p. 190]) 

1NFA(2,0) C 2DFA(k,0) 

lNFA(k,0) C 2DFA(k, 0) 
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Theorem 3. For l < 2, fc + 1 heads are strictly stronger than k heads. 

This results holds in all situations, whenever automata are 1- or 2-way, determin¬ 
istic or not, with or without pushdown stacks. 1 Even if some notes on the techniques 
and historic of those results exist [26, Chap. 4, Sect. 5.3, 22, pp. 67-68], no extensive 
survey was found, so the reader has to go for the original research papers [28, p. 338, 
20, p. 106, 21, p. 383, 8, p. 179, 17, p. 35]. 

Conclusion 

Automata theory is a major subject of computer science, very active and providing 
all kind of extensions and restrictions to automata. It contributed to “implicit” 
complexity in the sense that no external bound or measure is needed to tame their 
computational power: by specifying their number of ways, heads and stacks, one 
knows in advance the computational power of the device. 

Those “implicit characterizations” provided decisive hints and tools to design two 
(truly implicit) bounded programming languages [3, 4]. Numerous other inspiring 
results remains to be explored and should benefit to ICC. 

We did not mentioned finite state transducer, which are functional finite automata, 
but they also provide nice characterizations of functional complexity and beautiful 
results (even recently [12], where the main theorem fits in the title). The status 
of the input is also of interest: automata can bee feeded with 1-way inputs, trees, 
etc. That makes the expressive power to be really parametric in the input and the 
machine 
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